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(57) Abstract: A method of controlling brightness, colour, hue, colour temperature, gamma response or contrast of at least one 
image for display on a multi-layer display device characterized by carrying out the steps of: receiving said at least one image(s) to 
be displayed, detecting the brightness, colour, hue, colour temperature, gamma response or contrast of said image(s) to be displayed, 



determining the trans mi ssivity of each layer of the multi layer display device in the localized area of said image(s) to achieve the 



brightness, colour, hue, colour temperature, gamma response and/or contrast detected or received, communicating the determined 
transmi ssivity of each layer of the multi layer display device in the localized area of said image(s) to a display device or storage 
£^ device. A software device designed to do the same and a display device which can be utilized to controlling brightness, colour, hue, 
colour temperature, gamma response or contrast of at least one image. 
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ENHANCED VIEWING EXPERIENCE OF A DISPLAY THROUGH LOCALISED 
DYNAMIC CONTROL OF BACKGROUND LIGHTING LEVEL 

5 

TECHNICAL FIELD 

This invention describes a method to enhance the viewing experience of a flat panel display of 
10 any video or still imagery through the localized dynamic control of the background lighting level 
of a specific area or areas of a scene or succession of video frames. This can be accomplished 
using a unique arrangement of two stacked flat panel displays, one of which would control 
backlight brightness values synchronized to appropriate areas within the scenes or images of the 
visual content being presented on the other display. This control could be provided over the 
15 video signal cable (DDC), serial, USB or a customized type of interface protocol. 

BACKGROUND ART 

Multi-layered display (MLD) units provide a significant improvement over existing single layer 
display (SLD) units or displays. MLD units may be used to nest display content over spatially 
displaced or stacked layers to provide an enhanced mechanism for information absorption and 
20 analysis by users. An example of an existing multi-layer display is discussed for example in 
W09942889A. 

Reference throughout this specification will also be made to the present invention being used in 
conjunction with multi-layer displays of the type disclosed in W09942889A. However, those 
skilled in the art should appreciate that the present invention may also be adapted for use with 
25 other types of MLD units and reference to the above only throughout this specification should in 
no way be seen as limiting. 



WO 2004/002143 




PCT/NZ2003/000132 



The frequency spectrum of radiation incident upon a detector depends on the properties of the 
light source, the transmission medium and possibly the properties of the reflecting medium. If 
one considers the eye as a detector the human visual system can sense radiation that has a 
wavelength between 700nm and 380nm. Hence this is described as the visual part of the 
5 electromagnetic spectrum. Humans perceive certain frequency distributions as having different 
colours and brightness. A scheme was devised to describe any perceived colour and brightness 
via adding three basis spectral distributions with various weights. For example in the 1931 CBB 
colour space any perceivable colour may be described by the following equation: 

C = x r X + y r Y + z r Z 

10 Where C is the colour being described, Xr, Yr and Zr are the weights and X,Y and Z are 1931 
CLE tristimulis curves which are graphs of the relative sensitivity of the eye Vs wavelength. For 
any given colour, the weights may be determined by the following equations: 

x r = \C{X)X{X)d{X) 
y r = \C{X)Y(X)d{X) 

15 z r =\C(Z)Z{X)d(X) 

The 1931 co-ordinates are formed via the following normalisation: 

x X r 
*" X r +Y r +Z r 

Y r 

Vr X r +Y r +Z r 
z r = l-x r -y r 

20 These may be plotted on the 1931 CIE diagram. The spectral locus defines the pure spectral 
colours, that is the perception of radiation with a specific wavelength. Colour co-ordinates that 
are closer or farther from pure spectral colours are described as being more or less saturated 
respectively. The value of the y coordinate is also referred to as the luminance or the variable L. 
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Pixels on a transmissive display, that is a display that channels light from a rear mounted source, 
will be capable of maximum and minimum luminous states. If one labels the maximum state as 
Lb and the minimum as Ld then the contrast ratio is described by 



formed by mixing small areas of three basis colours with modulated intensities which are close 
in either spatial or temporal proximity. If the basis colours are plotted on the CDS diagram then 
the enclosed triangle contains all the colours producible by the system. The enclosed area is 
called the colour gamut and hence a display with a larger area can display a greater variation in 
1 0 colour and has a greater colour gamut. 

There are two main types of Liquid Crystal Displays used in computer monitors, passive matrix 
and active matrix. Passive-matrix Liquid Crystal Displays use a simple grid addressing system to 
supply the charge to a particular pixel on the display. Creating the grid starts with two glass 
layers called substrates. One substrate is given columns and the other is given rows made from a 
15 transparent conductive material. This is usually indium tin oxide. The rows or columns are 
connected to integrated circuits that control when a charge is sent down a particular column or 
row. The liquid crystal material is sandwiched between the two glass substrates, and a polarizing 
film is added to the outer side of each substrate. 

A pixel is defined as the smallest resolvable area of an image, either on a screen or stored in 
20 memory. Each pixel in a monochrome image has its own brightness, from 0 for black to the 
maximum value (e.g. 255 for an eight-bit pixel) for white. In a colour image, each pixel has its 
own brightness and colour, usually represented as a triple of red, green and blue intensities. To 
turn on a pixel, the integrated circuit sends a charge down the correct column of one substrate 
and a ground activated on the correct row of the other. The row and column intersect at the 
25 designated pixel and that delivers the voltage to untwist the liquid crystals at that pixel 




5 



The perception model described above accurately predicts that colours on displays can be 
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The passive matrix system has significant drawbacks, notably slow response time and imprecise 
voltage control. Response time refers to the Liquid Crystal Displays ability to refresh the image 
displayed. Imprecise voltage control hinders the passive matrix's ability to influence only one 
pixel at a time. When voltage is applied to untwist one pixel, the pixels around it also partially 
5 untwist, which makes images appear fuzzy and lacking in contrast. 

Active-matrix Liquid Crystal Displays depend on thin film transistors (TFT). Thin film 
transistors are tiny switching transistors and capacitors. They are arranged in a matrix on a glass 
substrate. To address a particular pixel, the proper row is switched on, and then a charge is sent 
down the correct column. Since all of the other rows that the column intersects are turned off, 
10 only the capacitor at the designated pixel receives a charge. The capacitor is able to hold the 
charge until the next refresh cycle. And if the amount of voltage supplied to the crystal is 
carefully controlled, it can be made to untwist only enough to allow some light through. By 
doing this in very exact, very small increments, Liquid Crystal Displays can create a grey scale. 
Most displays today offer 256 levels of brightness per pixel. 

15 A Liquid Crystal Display that can show colours must have three subpixels with red, green and 
blue colour filters to create each colour pixel. Through the careful control and variation of the 
voltage applied, the intensity of each subpixel can range over 256 shades. Combining the 
subpixel produces a possible palette of 16.8 million colours (256 shades of red x 256 shades of 
green x 256 shades of blue). 

20 Liquid Crystal Displays employ several variations of liquid crystal technology, including super 
twisted nematics, dual scan twisted nematics, ferroelectric liquid crystal and surface stabilized 
ferroelectric liquid crystal . They can be lit using ambient light in which case they are termed as 
reflective, or backlit and termed Transmissive. There are also emissive technologies such as 
Organic Light Emitting Diodes, which are addressed in the same manner as Liquid Crystal 

25 Displays. These devices are described hereafter as image planes. 

Another subset of LCDs, known as "transflective" or partially reflective displays, is important to 
consider. In this application, a portion of the rear part of the liquid crystal subpixel cell (either 
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internally or externally) is coated with a light reflecting material. The coverage achieved by this 
reflector material may comprise from 20% to 30% or more of the total active (light transmitting) 
area of a given subpixel. Any incident light on this part of the cell coming from a rear-mounted 
backlight would not be able to reach the viewer's eye unless it were diffused and re-reflected in 
5 another spot. However, the equivalent portion of ambient light from overhead fluorescent 
lighting or even the sun would pass through the cell's colour filter and liquid crystal layer to be 
reflected (after appropriate greyscale modification) back to the user. This system allows portable 
colour (or even monochromatic) displays such as Tablet PCs, PDAs, and even cell phones to be 
easily readable even in the harshest of ambient lighting environments without requiring the 
1 0 energy drain on a battery produced by an emissive backlight. 

Common to the display marketplace are "emissive" displays such as CRTs where the luminance 
of a characteristic colour, shade and brightness is derived from electronically excited photon 
emission at the subpixel site itself. There are other emissive display technologies which are 
consistent with this description such as those based on Organic Light Emitting Diodes (OLEDs), 
15 Electroluminesce (EL), and plasma. Each of these technologies can be used in conjunction with 
an overlying transmissive (or even transflective) liquid crystal display to achieve a Multi-Layer 
configuration. 

No known reproduction process can exactly capture the original elements in a given situation 
(e.g. the brightness of the sun shining down on a landscape). All colour reproduction systems 

20 can hope to do is replicate the relative differences between objects in the original view. The ratio 
of the whitest point to the blackest point in a scene is know as its dynamic range, which must be 
reproduced on some medium such as film, a CRT, an LCD, or paper. The characteristics of this 
medium, or its "native response," will determine the level of success a given reproduction 
achieves. The number of steps, or grayscale, into which this dynamic range can be subdivided 

25 determines the resolution of a particular primary colour. A typical monitor system will have the 
ability to display 8-bits, or 256 shades per primary colour for a total of over 16.7 million colours 
(256 x 256 x 256). This is known as the colour depth or image palette of the display system. 



5 



WO 2004/002143 




PCT7NZ2003/000132 



All display mediums, especially CRTs, introduce some amount of distortion, which has to be 
corrected to make the reproduced image look "proper." The human eye sees logarithmically. To 
compensate for this, playback or image reproduction media must mimic the human visual 
response curve so that the display shows information in a way we are used to seeing. The 
5 resulting response curve varies in an exponential manner known as the "gamma curve" which is 
a polynomial equation describing any point on a curve native to a particular monitor. In a typical 
imaging system, the brightness changes very little at the lower energy grey levels causing some 
compression of the shadow detail where our eyes are the most sensitive. So instead of a straight- 
line, linear response where there is an equal amount of output for every value of input, the curve 
1 0 has a long, shallow beginning before it begins to climb. 

Video or static images or scenes that are created, edited, stored, and then presented on flat panel 
media which displays them according to the luminance or brightness values which the author or 
editor imparts to them. Once they are imprinted and/or duplicated, further changes to the 
luminance properties of the content being displayed are only possible if applied to ALL the 
15 content Until now, no method has been devised for controlling individual portions of a given 
scene, frame, or series of frames in a prescribed, dynamic fashion. Such a device or method 
would be useful. 

All references, including any patents or patent applications cited in this specification are hereby 
incorporated by reference. No admission is made that any reference constitutes prior art. The 
20 discussion of the references states what their authors assert, and the applicants reserve the right 
to challenge the accuracy and pertinency of the cited documents. It will be clearly understood 
that, although a number of prior art publications are referred to herein, this reference does not 
constitute an admission that any of these documents form part of the common general knowledge 
in the art, in New Zealand or in any other country. 

25 It is acknowledged that the term 'comprise* may, under varying jurisdictions, be attributed with 
either an exclusive or an inclusive meaning. For the purpose of this specification, and unless 
otherwise noted, the term 'comprise' shall have an inclusive meaning - i.e. that it will be taken to 
mean an inclusion of not only the listed components it directly references, but also other non- 
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specified components or elements. This rationale will also be used when the term 'comprised' or 
'comprising' is used in relation to one or more steps in a method or process. 

It is an object of the present invention to go at least some way towards addressing the foregoing 
problems or to at least provide the public with a useful choice. 

5 Further aspects and advantages of the present invention will become apparent from the ensuing 
description which is given by way of example only. 

DISCLOSURE OF INVENTION 

The processes and tools described here are intended to describe the implementation of a visual 
imaging system capable of offering an enhanced video viewing experience when used with a 

10 multi-layer display arrangement. It accomplishes this by employing hardware and software 
techniques to adjust the parameters of the components of a portion or portions of the image on 
one display such as the gamma response, contrast ratio, colour temperature, and brightness- 
frame by frame— by varying the complementary parameters of the selected portion or portions of 
the frame being displayed on the other (under- or over-lying) image plane. A software utility can 

15 be designed so as to capture a frame of video information and calculate the values of the 
aforementioned parameters and adjust them accordingly through the use of special algorithms 
which then pass that value or values to a software lookup table (LUT) adjustable by the viewer 
wishing to create an enhanced or modified visual experience of the content being viewed. The 
values will be accepted by custom hardware and software driven devices which will then 

20 translate the commands into the subpixel chromaticity and brightness settings on one display that 
are required to modify the image being displayed on the other display. The controller device, 
with suitable switching adjustments, will be able to control the desired areas of either component 
of a multi-layer display stack. 

Accordingly in a first aspect of the invention may broadly said to consist in an image appearance 
25 controller for controlling brightness, colour, hue, colour temperature, gamma response or 
contrast of at least one image for display on a multi layer display device comprising: 
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i) a receiving means for receiving said at least one image(s) to be displayed; 

ii) a detecting means for detecting the brightness, colour, hue, colour temperature, 
gamma response or contrast of said image(s) to be displayed, 

iii) a determining means for determining the transmissivity of each layer of the multi 
layer display device in the localised area of said image(s) to achieve the brightness, 
colour, hue, colour temperature, gamma response and/or contrast detected or 
received, 

iv) a communicating for communicating the determined transmissivity of each layer of 
the multi layer display device in the localised area of said (images) to a display 
device or storage device. 

A further aspect of the current invention may broadly said to consist in an image appearance 
control system for controlling brightness, colour, hue, colour temperature, gamma response or 
contrast of at least one image for display on a multi layer display device carrying out the steps 
of: 

i) receiving said at least one image(s) to be displayed; 

ii) detecting the brightness, colour, hue, colour temperature, gamma response or 
contrast of said image(s) to be displayed, 

iii) determining the transmissivity of each layer of the multi layer display device in the 
localised area of said image(s) to achieve the brightness, colour, hue, colour 
temperature, gamma response and/or contrast detected or received, 

iv) communicating the determined transmissivity of each layer of the multi layer display 
device in the localised area of said (images) to a display device or storage device. 

As such the current invention is a method to or apparatus designed to control and enhance the 
brightness, colour, hue, colour temperature, gamma response or contrast of at least one image to 
be displayed on a multi layer display device by controlling the transmissivity of the layers of 

8 
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said multi layered device in the localised area of said image(s). 

The term 'transmissivity' as used herein should be interpreted as meaning the degree of 
transmission of light through a transmissive layer or item. In particular the transmissivity should 
be interpreted as the transmission in terms of colour or chromaticity and brightness of light 
5 passing through that layer or item. 

The term 'image* as used herein should be interpreted as meaning any type of image for example 
(without limitation) any content, display element, image, scene, ranging from static to video 
images or any part there-of. 

Preferably the receiving means or the step or receiving the image(s) is adapted to receive full 
1 0 scenes and video images. 

Preferably the receiving means or the step of receiving the image(s) is able to receive the 
brightness and colour of each pixel of the image(s). 

Preferably the detecting means or the step of detecting brightness, colour, hue, colour 
temperature, gamma response and/or contrast step detects the overall brightness, colour, hue, 
1 5 colour temperature, gamma response and/or contrast of the image(s) to be display and preferably 
it is implemented for example by means of software or hardware which is controlled by a user 
who interacts with it to define the level of contrast, brightness and/or colour of said image(s) 
desired. Alternatively the brightness, colour, hue, colour temperature, gamma response and/or 
contrast may be determined by a software application. 

20 Preferably the determining means or the step of determining calculates the transmissivity of each 
pixel of the image on each layer by reference to the brightness and colour of each pixel of the 
image, the brightness, colour, hue, colour temperature, gamma response and/or contrast to be 
determined and then by reference to a pre-defined algorithm or look-up table or alternatively an 
algorithm or look up table which can be adjusted by the user or software developer the 

25 transmissivity of each pixel on each layer of the multi layer display is determined- Typically this 
will involve one layer displaying the image received and a second layer controlling the 

9 
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brightness, colour, hue, colour temperature, gamma response and/or contrast. 

Preferably the determining means or the step of determining throughout this .specification is 
definable by a user/content developer to allow customisation to allow the particular gamma 
response of each layer of the intended multi layer display device or alternatively any preferred 
5 gamma curve to be factored in which calculating the transmissivity of each layer of the multi 
layer display device in the localised area of each image. 

Preferably the image appearance control system or image appearance controller is attached to a 
multi layer display device upon which, by utilising appearance control system or image 
appearance controller, images can be displayed with enhanced or controlled brightness, colour, 
1 0 hue, colour temperature, gamma response and/or contrast of said image(s). 

Preferably the means of communication or communicating step can communicate with 
individual display layers of multi layer display device or alternatively can communicate with a 
recording or storage device such as a CPU that is able to record or store the level of 
transmissivity of each display layer for subsequent retrieval and display of images with enhanced 
15 or controlled contrast. 

Accordingly in a first aspect of the invention may broadly said to consist in a brightness, colour, 
hue, colour temperature, gamma response or contrast controller for controlling brightness, 
colour, hue, colour temperature, gamma response or contrast of at least one image for display on 
a multi layer display device comprising: 

20 i) a receiving means for receiving said at least one image(s) to be displayed; 

ii) a detecting means for detecting the brightness, colour, hue, colour 
temperature, gamma response or contrast of said image(s) to be - displayed, 

iii) a determining means for determining the transmissivity of each of the non- 
display layers of the multi layer display device in the localised area of said 

25 image(s) to achieve the brightness, colour, hue, colour temperature, gamma 

response and/or contrast detected or received, 
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iv) a communicating for communicating the determined transmissivity of the 
non-display layers of the multi layer display device in the localised area of 
said (images) to a display device or storage device. 

A further aspect of the current invention may broadly said to consist in a brightness, colour, hue, 
5 colour temperature, gamma response or contrast control system for controlling brightness, 
colour, hue, colour temperature, gamma response or contrast of at least one image for display on 
a multi layer display device carrying out the steps of: 

i) receiving said at least one image(s) to be displayed; 

ii) detecting the brightness, colour, hue, colour temperature, gamma response or 
1 0 contrast of said image(s) to be displayed, 

Hi) determining the transmissivity of each of the non-display layers of the multi 
layer display device in the localised area of said image(s) to achieve the 
brightness, colour, hue, colour temperature, gamma response and/or contrast 
detected or received, 

15 iv) communicating the determined transmissivity of each of the non-display 

layers layer of the multi layer display device in the localised area of said 
(images) to a display device or storage device. 

The term 'non-display layers' as used herein should be interpreted as the layers capable of 
controlling brightness, colour, hue, colour temperature, gamma response or contrast on which the 
20 . image as originally received is not displayed. So in a two layered multi layer display consisting 
of two LCDs which are backlit, one layer would be a display layer on which images are 
displayed and the other layer would be a 'non display layer' with which brightness, colour, hue, 
colour temperature, gamma response and/or contrast of images is controlled. 

As such the invention is a method of controlling brightness, colour, hue, colour temperature, 
25 gamma response or contrast of an image which is to be displayed on a display as received, 
unaltered. So the image(s) received can be displayed without altering the transmissivity of the 
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layer on which it is (they are) to be displayed and their appearance (brightness, colour, hue, 
colour temperature, gamma response or contrast) can be controlled and enhanced through the 
control of transmissivity of the other layers in the localised area of said image(s). 

Accordingly in another aspect of the current invent can broadly be said to consist in an image 
5 appearance controller or an image appearance control system which controls at least two of the 
following attributes of an image (or images) in combination utilising the methods or steps 
described here-in: brightness, colour, hue, colour temperature, gamma response or contrast 

As such the current invention is a method to or apparatus designed to control the controlling 
brightness, colour, hue, colour temperature, gamma response or contrast in combination, of at 
10 least one image to be displayed on a multi layer display device by controlling the transmissivity 
of the layers of said multi layered device in the localised area of said image(s). 

Preferably the means of detecting means or step of detecting is able to detect information as to 
brightness, colour, hue, colour temperature, gamma response or contrast of an image or image(s) 
in combination. 

15 Preferably the current invention is embodied in software or hardware whereby the user or 
content developer defines brightness, colour, hue, colour temperature, gamma response or 
contrast of each image he or she desires to display which is detected by the means of detecting or 
the detecting step, the determining step or means of determining calculates the localised 
transmissivity of each layer of the multi layer display for each image and the communicating 

20 step or means of communicating stores communicates that information for storage or display on 
an multi layer display system. 

Accordingly in another aspect of the current invention can broadly be said to consist in an image 
appearance controller or an image appearance control system for use with a multi layer display 
device utilising the methods or apparatus of controlling the contrast of an image or images as 
25 described here-in while brightness of said image(s) is maintained utilising the methods or 
apparatus described here-in such that net brightness perceived of the image(s) is maintained 
despite any change to contrast. 
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As such the current invention is a method to alter contrast of an image or images without giving 
the viewer the perception of any change in brightness. That is, while a change in contrast of an 
image or image(s) at the detecting step or the means of detecting causes the determining means 
to increase or reduce overall brightness (depending on the contrast change) of said image(s), the 
5 determining means would additionally determine the transmissivity of each layer of the multi 
layer display in the localised are of images so controlled in order that the overall brightness of 
said images would be maintained. 

Preferably the determining step or the means of determining will determine or calculate the 
transmissivity of brightness to remain the same despite any adjustment to or control of contrast. 
10 In this manner the user is able to define the contrast of an image or images without having to 
additionally adjust the brightness of such image(s). The automatic control of the brightness is 
performed using the methods or apparatus of controlling brightness as described here-in. 

Equally a contrast can be maintained despite any change in brightness of an image. 

Preferably the determining means or the step if determining can determine the transmissivity of 
15 each layer independently, such that the transmissivity determined of each layer in the localised 
area of the image(s) to be subsequently displayed can be different, or independently determined. 

According to a further aspect of the current invention, a device is implemented to carry out the 
methods of controlling brightness, colour, hue, colour temperature, gamma response or contrast 
utilising the methods set out here-in. 

20 Preferably the embodiment of the invention comprises a software which carries out the step of 
receiving or detecting the desired or specified brightness, colour, hue, colour temperature, 
gamma response or contrast of the image to be displayed and on this basis the determining 
means or the step of determining, determines the transmissivity of each layer of the MLD. 

This device is further described in the best modes of carrying out the invention below. 

25 Accordingly in a further aspect of the invention may broadly said to consist in a display with 
enhanced image control comprising: 

13 
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i) at least one display device which is (are) at least in part selectively transparent 
upon which at least one image is displayed; 

ii) and a backlighting system which illuminates said image(s); 

iii) and at least one transmissivity control device that selectively controls the 
5 transmission of light from said backlight to the viewer in the localised area of 

said image(s). 

The term 'backlight system' as used herein should be interpreted as meaning any type of system 
which illuminates a display device at least in part from behind that display device by any means 
including for example (but without limitation) phosphorous tubes as seen in typical Liquid 
1 0 Crystal Display arrangements. For the avoidance of doubt, the source of the light need not be or 
need not solely be behind the display. 

In a preferred embodiment of the current invention the at least one display device in the current 
invention is a (are) Liquid Crystal Display panel(s). 

In a preferred embodiment of the current invention the at least one transmissivity control device 
15 in the current invention is a (are) Liquid Crystal Display panel(s). 

Accordingly a further aspect of the present invention consists is a display comprising of: 

i) at least one display device which emanates its own light upon which at least one 
image is displayed; and 

ii) at least one transmissivity control device that selectively controls the transmission 
20 of light from said display device to the viewer in the localised area of said 

image(s). 

A display comprising of: 

i) at least one display device which is a transflective display device, upon which at 
least one image is displayed; 
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ii) at least one transmissivity control device that selectively controls the transmission 
of light from said display device to the viewer in the localised area of said 
image(s). 

Preferably the at least one display device is adapted to display video images and preferably it is 
5 adapted to be attached to a CPU or other device from which it can receive images to be displayed 
such as a DVD player. Preferably the at least one display device may be driven through software 
code of computer based instructions loaded into a programmable logic device such as a computer 
or a microprocessor. 

Preferably the at least one transmissivity control device it is adapted to be attached to a CPU or 
1 0 other device from which it can receive transmission levels such as a DVD player. Preferably the 
at least one transmissivity control device may be driven through software code of computer 
based instructions loaded into a programmable logic device such as a computer or a 
microprocessor. 

Preferably the at least one transmissivity control device and the at least one display device same 
1 5 device are adapted to be driven or controlled by the same device. 

Preferably the at least one transmissivity control device is adapted to selectively control the 
transmission of light on the basis of user or software defined preferences associated with the 
image to be displayed on the display device. For example a user, content developer or publisher 
may define the level of transmission of light associated with a particular image. 

20 Preferably the at least one transmissivity control device is adapted to control the transmission of 
light specific to the shape of the image or images being displayed. 

Preferably the at least one transmissivity control device and the at least one display device 
display are adapted to be driven in conjunction so that the transmissivity control device controls 
the transmission of light associated with the image(s) on the display device. 

25 Adding the extra dimension of control imparted by a second display vertically stacked behind 
the panel displaying the video content allows this brightness adjustment to occur in a localized 
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area or areas rather than being applied to the entire scene in a given frame. Appropriate and 
selective blockage of the backlight luminance level can be accomplished by applying variously 
darker neutral grey levels (at 50% transmission, for instance) to the pixels of the second display 
directly behind the portions of the scene one might wish to be de-emphasized or occluded. 
5 Conversely, the pixels behind areas of the image one wishes to be made brighter can be driven at 
grey levels corresponding to full or 100% transmission so as to allow all the backlight power to 
illuminate those areas. 

The control of colour or "chromaticity" for example allows the image to be saturated (or less 
saturated as the case may be) with colour. 

10 In addition to brightness levels, recorded levels for image attributes such as hue, saturation, and 
colour temperature may also be present. 

Regardless of the type of display device utilised as described here-in, the display is capable of 
controlling the brightness, colour, hue, colour temperature, gamma response or contrast of an 
image or images by way of the transmissivity control device selectively controlling the 
1 5 brightness, colour, hue, colour temperature and/or contrast of said image(s) to be displayed in the 
localised area. 

The visual digital media applications that could be enhanced with this method include DV, 
HDTV, eCinema, DVD, QuickTime, AVI, RealVideo, etc; vector animation such as Flash; 
presentation software such as PowerPoint, slide-show software etc; tagged static image file 
20 formats such as JPEG or GIF images in web pages, PhotoCD, TIFF, PhotoShop, etc. 
Enhancements to the viewing experience described herein will be particularly valuable to the 
entertainment and publishing industries. 

Methods are possible to one skilled in the art whereby the brightness of the display can be 
synchronized to the static or video image content being displayed on a flat panel device. 
25 Software can be written to examine the grey scale content of a frame or a series of frames to 
compute, for instance, an arithmetic mean of the changing (dynamic) brightness level. 
Depending on present values from a given group of parameters, the software can cause 
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instructions to be transmitted through a suitable application programming interface (API) to a 
backlight driver to dynamically adjust the brightness level of the display by controlling the 
voltage levels of lamp or lamps illuminating the display. 

Accordingly, in a further aspect of the invention may broadly said to consist in an enhanced 
5 method of controlling transmissivity of light in the localised area of image(s) where the at least 
one transmissivity control device and the transmissivity of the at least one display device being 
controlled in conjunction to maintain the same or a similar level of luminance of said image(s) as 
would be experienced by the viewer when no transmissivity control device is present or was 
present but was not acting to block or filter light. 

10 In the first case where the backlight luminance is partially blocked, the gamma response curve of 
the pixels of the corresponding area on the display showing the video content may now be 
altered so as to increase their transmissivity. This increase, while not altering the net brightness 
level reaching the observer, will allow for an increased level of actinic stimulus of his visual 
cortex. Hence, by synchronously lowering the backlight brightness level through the use of a 

15 transmissivity control device and decreasing the gamma value of an image so that the same 
resultant luminance level is maintained, a more vibrant colour impact can be achieved than 
before possible with non-dynamic playback. 

Preferably the current invention is adapted such that the net luminance level is maintained or 
approximately maintained such that the viewer's viewing experience is enhanced through 
20 improved contrast by limiting the transmission of light to the display device through the use of 
the transmissivity control device while at the same time increasing the transmissivity of the 
display device. 

The present invention may provide many potential advantages over the prior art. 

BRIEF DESCRIPTION OF DRAWINGS 

25 Further aspects of the present invention will become apparent from the following description 
which is given by way of example only and with reference to the accompanying drawings in 
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which: 

Figure 1 illustrates a diagram of the display device and transmissivity control device 

used in conjunction to display a scene with improved colour and contrast 
characteristics; and 

5 Figure 2 illustrates a flowchart diagram of information flows and steps executed by 

software to display images with improved colour and contrast characteristics. 

Figure 3 illustrates a sample image control software panel associated with a preferred 

embodiment. 

BEST MODES FOR CARRYING OUT THE INVENTION 

10 Figure 1 illustrates a diagram of the display device and transmissivity control device used in 
conjunction to display a scene with improved colour and contrast characteristics. 

In the instance shown, a transparent LCD layer or panel acting as a display device (1) and a 
further transparent LCD layer or panel acting as an transmissivity control device (2) are arranged 
and displaced in a line with respect to one another, however, in use, the display device and 

15 transmissivity control device are aligned directly in front of the next to form a stacked or 
sandwiched construction. The scene to be displayed consists of a hilltop, the moon, and the 
nights sky (3a, b and c), which are displayed upon the display device. Light enters from a 
backlighting system (not illustrated) behind the transmissivity control device (4). The 
transmissivity control device controls this light, selectively in the localised area of the images. 

20 As such the resultant light exiting the transmissivity control device in the case of the moon (5a) 
is bright and saturated in yellow colour (colour not illustrated), and in the case of the hilltop the 
resultant light less intense and less saturated in colour (5b). Light entering the transmissivity 
control device in the localised area of the night's sky is blocked to the greatest degree possible 
(if not completely) by both the transmissivity control device and the display device. The 

25 resultant image displayed on the display device has increased contrast ratio particularly between 
the moon and the night's sky and additionally the colour of the images is more vibrant. 
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In the preferred embodiment illustrated the display comprises two LCDs which are stacked in 
construction. Those LCDs are preferably colour LCDs, although alternatively it is less expensive 
to use a grey-scale LCDs. In particular a grey-scale LCD acting as an transmissivity control 
device can be used in combination with a colour LCD acting as a display device. This colour 
5 LCD / grey-scale LCD combination or multiple grey-scale LCD combination will effectively 
control illumination of the images but will add little to the colour enhancement attributes 
described in the current invention and as such contrast ration is effectively controlled but not 
colour saturation or other colour characteristics. 

In this preferred embodiment of two layered LCDs moire interference may result due to the 
1 0 layering of like patterns and this may be overcome or limited through the use of a light diffusing 
device such as an random homogenous layer placed between the LCDs and such interstitial 
layers need to be factored in which determining the transmissivity of layers of the multi layer 
display device. 

Alternatively the LCD in front (from the viewer's perspective) is used as the illumination 
1 5 controlling device and the LCD in the rear is used as the display device. 

Preferably the LCD layers are constructed so that there is as little distance as possible between 
the two layers. 

In this preferred embodiment of two stacked LCD layers can be used in their normal way as 
addressable image display devices and can be attached to a CPU or other device driver. As such 
20 the many software applications for content production and editing can be used in conjunction 
with the present invention. 

In this preferred embodiment of two stacked LCD layers the rear layer can be used as both for 
the purpose contrast and colour enhancement as described in this invention and also if those 
layers are displaced by distance the embodiment can be used for the purpose independent image 
25 display such that different images can be displayed on the front and rear layers with depth 
enhanced perception. 
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In a further preferred embodiment, the enhancement of contrast ratio and colour takes place on 
the basis of user interaction. This user interaction embodiment involves attaching the display to a 
CPU or other device driver such that the user can determine the level of illumination control he 
or she requires to enhance the images displayed on the display device - in terms of brightness, 
5 contrast, hue, colour temperature and of colour. The user is able to interact with a software 
application, specifying the brightness and colour he or she wishes to be perceived when the 
image is viewed and the software application drives both the transmissivity control device and 
the display layer to display an image with those specified characteristics. He or she may 
preferably control the gamma curve of each layer utilised in calculating transmissivity of that 
10 layer. Preferably the level of illumination and colour control the transmissivity control device 
exhibits is controlled by a sliding scale controlled for example by a mouse of key-strokes with 
which the user interacts. Alternatively the device with which the user interacts can be hardwired 
and the user interacts with physical sliders or knobs. 

Utilising this preferred embodiment of user interaction, colour and contrast enhanced images or 
1 5 indeed entire movies could be pre-recorded for playback using a CPU or other device driver such 
as a DVD. The viewer of this preferred embodiment would largely be unaware of the 
mechanisms controlling such enhancement of colour and contrast but would enjoy an improved 
viewing experience. 

Figure 2 illustrates a flowchart diagram of information flows and steps executed by software to 
20 display images with improved colour and contrast characteristics. In figure 2 execution starts a 
block A which is the step of an image file being present in an addressable format (preferably Red 
Green Blue format). The flowchart proceeds to block B which is the processing stage. Processing 
of an image is undertaken either on the basis of user defined preferences or on the basis of pre- 
defined settings whereby the contrast or illumination and the colour or chromaticity is defined. 
25 The processing stage then presents two pieces of information from one of which is the 
information required to drive the transmissivity control device (C) for display on the 
transmissivity control device (D). The other information presented by the processing stage is the 
information required to drive the display device (E) which is displayed on the display device (F). 
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Obviously the combination of the user controlled contrast ratio and colour enhancement 
embodiment with the two stacked LCD layers embodiment would allow the user / content 
developer to precisely control the viewing characteristics of the image to be displayed. 

Figure 3 illustrates a sample image control software panel associated with a preferred 
5 embodiment where there is an is an application that reads the display screen, calculates a value, 
optionally corrects it, outputs the value to an appropriate information transferral port, and 
optionally corrects the display gamma. 

The calculated value is the average grey level of the subpixels in the area intended to be changed 
or modified. Gray is calculated using: 

10 grey = red * 0.3 + green * 0.59 + blue * 0. 1 1 

The calculation is performed according to a timer which can be initiated, for instance, every 100 
milliseconds. However, if the calculation takes longer than 100 milliseconds then the calculation 
is done less frequently. The time for each frame calculation is displayed in the "Time to compute 
frame" readout in the sample control panel figure (Figure 3). 

15 For instance, as a default setting, the application could be set to read every eighth pixel, 
horizontally and vertically. That is, one out of every 8x8 or 64 pixels is used to compute the grey 
value for the gamma determination. This can be adjusted using the Skip Pixels option. There are 
settings for 1, 2, 4, 8, and 16 pixels. When set to 1, every pixel on the screen is read. 

The calculated gamma response, for instance, can be affected by a lookup table. This is a table 
20 of, say, 256 floating point values, normally in the range 1.0 to about 2.3, that can adjust the 
brightness of each subpixel or groupie of subpixels in a single area or multiple areas in response 
to a measured value. The table can be edited by changing the text file named "gamluttxt" which 
could be located in the same directory as the application. If "Use gamma hit" is checked in the 
application (as illustrated), then the adjusted brightness is run through the gamma lut table to 
25 produce a floating point value which is output to the device gamma table. For example if the 
adjusted brightness is 125 and a certain gridpoint location, and the gamma lut contains the value 
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1.5 at location 125, then a gamma 1.5 table is computed and the windows display device is 
updated. Unchecking "Use gamma hit" in the application (as illustrated) would set a gamma of 
1.0. 

The brightness and gamma lookup tables are reloaded from their text files at the time the Start 
5 button is pressed. This makes it more convenient to change the hits and see the effect. The files 
must each contain 256 values separated by carriage return and line feed (CR LF, or the Enter 
key). 

To edit the lookup tables, one can use any text editor such as Notepad, or even Microsoft Excel. 
For example, the original values might read: 



10 



1 
2 



254 

15 255 

In order to obtain a gain of, for instance, 2X, the operator would modify the table to read: 
2 
3 
4 



254 
255 
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A library of similar algorithms for the other parameters such as colour temperature, brightness, 
etc. can be available for a user to perform modifications to them in selected portions of the 
image. 

Aspects of the present invention have been described by way of example only and it should be 
5 appreciated that modifications and additions may be made thereto without departing from the 
scope thereof. 
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WHAT WE CLAIM IS 

1. A method of controlling brightness, colour, hue, colour temperature, gamma response or 
contrast of at least one image for display on a multi layer display device characterised by 
carrying out the steps of: 

i) receiving said at least one image(s) to be displayed, 

1 

ii) detecting the brightness, colour, hue, colour temperature, gamma response or 
contrast of said image(s) to be displayed, 

iii) determining the transmissivity of each layer of the multi layer display device 
in the localised area of said image(s) to achieve the brightness, colour, hue, 
colour temperature, gamma response and/or contrast detected or received, 

iv) communicating the determined transmissivity of each layer of the multi layer 
display device in the localised area of said (images) to a display device or 
storage device. 

2. A method of controlling brightness, colour, hue, colour temperature, gamma response or 
contrast of at least one image for display on a multi layer display device characterised by 
carrying out the steps of: 

i) receiving said at least one image(s) to be displayed, 

ii) detecting the brightness, colour, hue, colour temperature, gamma response or 
contrast of said image(s) to be displayed, 

iii) determining the transmissivity of each of the non-display layers of the multi 
layer display device in the localised area of said image(s) to achieve the 
brightness, colour, hue, colour temperature, gamma response and/or contrast 
detected or received, 

iv) communicating the determined transmissivity of the non-display layers of the 
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multi layer display device in tke localised area of said (images) to a display 
device or storage device. 

3. A method of controlling the brightness, colour, hue, colour temperature, gamma response 
or contrast of at least one image to be displayed in combination as claimed either of 
claims 1 or 2. 

4. A method of controlling the contrast of at least one image to be displayed utilising the 
method as claimed in either claim 1 or 2 while brightness is maintained utilising the 
method claimed in either claim 1 or 2 such that net brightness perceived of the image(s) 
is maintained despite the change to contrast 

5 . A device implemented to carry out any of claims 1 to 4. 

6. A display comjprising of; 

i) at least one display device which is (are) at least in part selectively transparent 
upon which at least one image is displayed; 

ii) and a backlighting system which illuminates said image(s); 

iii) and at least one transmissivity control device that selectively controls the 
transmission of light from said backlight to the viewer in the localised area of 
said image(s). 

7. A display comprising of: 

i) at least one display device which emanates its own light upon which at least 
one image is displayed; and 

ii) . at least one transmissivity control device that selectively controls the 

transmission of light from said display device to the viewer in the localised 
area of said image(s). 

8 . A display comprising of: 
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i) at least one display device which is a transflective display device, upon which 

at least one image is displayed; 

ii) at least one transmissivity control device that selectively controls the 
transmission of light from said display device to the viewer in the localised 
area of said image(s). 

9. A display as described in any of claims 6 to 8 where the at least one transmissivity 
control device selectively controls the brightness, colour, hue, colour temperature and/or 
contrast of said image(s) to be displayed in the localised area. 

10. A display as claimed in any of claims 6 to 9 where the at least one transmissivity control 
device and the transmissivity of the at least one display device are used in conjunction to 
control contrast in the localised area of said image(s) to be displayed while brightness of 
said image(s) is maintained despite that change in contrast. 

1 1 . A display as claimed in any of claims 6, 8, 9 or 10 in which the display device(s) is (are) 
Liquid Crystal Display panel(s). 

12. A display as claimed in any of claims 6, to 11 in which the transmissivity control 
device(s) is (are) Liquid Crystal Display panel(s). 
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